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1. INTRODUCTION 

The digital revolution of the internet and social media leads to the transmission of many multimedia 
signals over the internet. Compression plays a vital role in limiting the bandwidth and storage space of 
multimedia signals like image audio and video. In 2004, David Donoho and his team proposed compressive 
sensing a signal sampling theory with captures the signal efficiently and the signal is recovered back with 
fewer samples thus reducing the dimensionality of signals known as sparse or compressible [1]-[3]. 

In traditional sampling, the signals are sampled and then compressed whereas in compressive 
sensing the signals are based on the signal sparsity [4]. Sparsity is a property of an image with most of the 
elements is zero and the image can be represented by a few non-zero elements image. The sparsity of the 
matrix is the ratio of zero value elements to the total number of elements. A sparse basis matrix [5] can be 
obtained from the traditional matrixes like discrete wavelet transform (DWT), discrete cosine transform 
(DCT), and discrete Fourier transform (DFT). For example, natural images are highly sparse in wavelet while 
speech signal and medical images have sparsity representation Fourier and random transform [6]. Let X be 
the original image with NxN matrix elements [7] which is transformed into transform data Y then Y can be 
expressed as (1). 
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Y = Y(X) (1) 


If the entries in matrix Y are close to zero then X is said to be sparse on some basis wy. 

The acquisition model [8] can be mathematically represented as Y= y X where X is input signal of 
size N, y is random measurement matrix of size MxN and Y is the measurement vector of size M. At the 
processing end of the reconstruction model [9], the measurement vector Y and reconstruction matrix © is 
space basis X then X is (2). 


x = Di Sipi (2) 


Let K be sparsity vector S [10], [11], then the matrix must satisfy restricted isometry property (RIP) and for 
reconstruction, the measurement matrix w and sparse basis should be incoherent [12]. 


2. RELATED WORKS 

The image compression system presented in [13] uses the different techniques for the choice of 
image compression techniques and for setting up a compression ratio. The image compression was carried 
out in phases where the first step was to compress the image using DCT, the second to reconstruct, and 
finally to train a set of images. The paper discusses the design of image compressed sensing (CS) to reduce 
redundancy based on objective criteria and subjective criteria. 

The hardware implementation of CS in [14] was done in field-programmable gate array (FPGA) 
which is the best platform for reconfigurability. The image was stored in synchronous dynamic random- 
access memory (SDRAM) and a sparse matrix is generated using the transformation process. The recovery of 
the image was found to be more complex and time-consuming. 

An efficient compression scheme in wireless sensor network (WSN) proposed in [15], [16] presents 
a new architecture and protocol to achieve energy efficiency and transmit the image over WSN the 
architecture optimizes high speed in image compression implemented with limited hardware and the power 
consumption is low. The literature [17], [18] presents the image packet queue to minimize error rate and thus 
improving the throughput of image transmission. The block compressive sensing proposed in [19] divides the 
image into blocks thereby maximizing the sparsity and employs an adaptive threshold thereby allocating 
measurements based on the sparsity of individual blocks with a predetermined measurement ratio. 


3. STATE-OF-THE-ART COMPRESSIVE SENSING 
Signal and image processing systems rely on the recovery of signals from the information [20]. When 
the signal acquired is linear, then it can be solved using the linear system equations mathematically as (3): 


Y = Ax (3) 


where Y is observed data, which is eC™ and connected to XeCN. 

The matrix AeC™N is the measurement matrix. Traditionally the number of measurements m should 
be as large as N. If m<N then the linear system is underdetermined with infinite solution, which makes 
recovery of X from Y impossible. The above technology is related to the Shannon sampling theorem. Figure 1 
shows the block diagram of the compressive sensing and also describes the acquisition model as well as the 
reconstruction model. The reconstruction algorithms that make this underlying assumption possible is 
sparsity as shown in Figure 1. 


3.1. Acquisition model 

The measurement of the signal is made randomly [21] by different techniques like random 
modulator, modulated wideband converter (MWC), random modulation pre-integrator (RMPI), random 
filtering, random convolution compressive multiplexer, random equivalent sampling, random triggering 
based modulated wideband compressive sampling, and quadrature analog to information converter. The 
proposed a compressive sampler, random [22] which samples the signals below the Nyquist rate. The low 
pass filter (LPF) results in a unique frequency signature in the low region. The high-frequency signal lies in 
the low-frequency region. This unique frequency signature gives the original signal in random measurements 
and finds its application for wideband signal acquisition. MWC uses a parallel architecture. The input signal 
is multiplexed by different chipping sequences and then passed via LPF thus sampled below the Nyquist rate 
and can be used for the wideband signal. RMPI is a combination of MWC with a parallel version [23] of 
random and only the difference is RMPI uses integrator instead of LPF by which the resultant is a different 


Int J Elec & Comp Eng, Vol. 12, No. 5, October 2022: 5063-5072 


Int J Elec & Comp Eng ISSN:2088-8708 O 5065 


reconstruction method that helps in acquiring the ultrawideband signal. The random filtering method 
performs convolution with finite impulse response (FIR) and it finds its application in compressing 
continuous and streaming signals. The random convolution consists of random pulses and then the pulses are 
obtained by a circular shift of the first row and can be used as a universal acquisition. In compressive 
multiplexer, the parallel architecture samples multichannel data to obtain a sub-Nyquist rate. 


Figure 1. Block diagram for compressive sensing 


3.2. Measurement matrix 

The measurement matrix plays a vital in compressing the signal, therefore choosing a measurement 
matrix is important for accuracy and less processing time to recover the signal [24]. Figure 2 gives the 
different types of measurement matrices deployed for compressive sensing. It is broadly classified into the 
deterministic and random matrix. 


Figure 2. Different types of measurement matrix 


a. Random matrix 

Random matrices are identical and independent matrices that are generated by the distribution like 
normal, random, and Bernoulli functions. The random matrix is broadly classified into structured and 
unstructured matrix unstructured matrices are generated randomly. This matrix includes Gaussian, Bernoulli, 
and uniform matrix. 
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b. Gaussian matrix 
The elements are distributed normally and the elements are independent except 0 and o? (variance). 
The probability distribution function is (4). 


Where u is mean, o is standard deviation, and g? is variance. 


K < CN log (=) + Cz loge -1 (5) 
Where S is sparsity, N is No. of measurements, L is length of sparse, and C1, C2 is circulant matrix. 
c. Bernoulli matrix 


1 1 
— — 0r — 


= = with outcomes n=0 


Bernoulli matrix denoted as BeR, mxn have equal probabilities at 
and n=1. The PDF of the Bernoulli matrix is 


~forn =0 


F(n) = | Which satisfies RIP (6) 


1 
zforn =1 


d. Structured random matrices 

Unstructured matrices are slow and not advisable for large-scale problems since structured matrices 
follow a structure [25] this reduces storage time and randomness. 
e. Random partial Fourier matrix 

Consider the matrix F NxN whose entry is 


2mikj 
N 


(F) xj = exp (7) 
and k, j takes the value of {1,2 ...N}. The restricted isometric property (RIP) is also satisfied for the material 
by randomly choosing M rows M = CK log N / e. Where M is No. of measurements, K is sparsity, and N is 
length of sparse signal. 
f. Random partial Hadamard matrix 

The entries are 1 and -1 for the Hadamard matrix and the column is orthogonal. Consider a matrix H 
with order n, Then H. HT = NIy. Where Iy is Identity matrix and HT” is transpose of H. 
g. Deterministic matrices 

The matrix follows a deterministic condition for satisfying the RIP. They are divided into semi- 
deterministic and full-deterministic. 
h. Semi-deterministic matrix 

Semi-deterministic matrices are generated in two steps. The first column is generated randomly and 
the full matrix is generated by applying a transformation to the first column thus generating the rows of the 
matrix. 
i. Circulant matrix 

The entry for the matrix is Cj = Cj — 1, where C = (c4 Cz ...Cy) and i,j = {1 ... N} thus the resultant 
matrix is circulant. 


Gh Cnzi sey eae Gi 
C= a Cn See ee C2 (8) 
C nai Cn-2 Cn 


j. Toeplitz matrix 
The resultant Toeplitz matrix T is associated with t = (t4, tz . tn), Tij = tj-; with constant diagonal 


Tij = tj+1 j+t- 
te tri ty 
tn4+1 | eee t 
T= e K f (9) 
t2n-1 tz2n-20 t" tn 
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k. Full deterministic matrices 
The matrices are purely based on RIP properly. 
1. Chirp sensing matrix 
The matrix is based on non-cyclic codes where the columns are generated by chirp signal. The 
matrix of the chirp is given by Acnrip = [Ur1 Urz Urz + Urw] and U,, = (t = 1...w) with MxM matrix. 
m. Binary BCH matrices 
Binary Bose Chaudhuri Hocquenghem (BCH) matrix is a cyclic matrix and given by (10). 


1 a q2 a@-D 
H=]1 a@ aq... gD (10) 


3.3. Recovery algorithm 

The recovery of the original signal after compression is the essential step of compressive sensing. 
The recovery algorithms are classified into six different categories as shown in Figure 3. Incoherence and 
RIP are two important factors for the reconstruction of the compressed signal. The maximum correlation 
between two elements in a pair of matrices is incoherent that involves quantity to measure the suitability of 
g [26]. Let the measurement metrics p and sparse basis ¥ are said to be incoherent to each other. The 
coherence range is W[g, y] € |1, vn]. The recovery is better when coherence is small. Let the sparsity of 
vector S be K, then, to recovery from measurements Y [27] the matrix should satisfy RIP with order K 


P <lulzcrag (11) 
Ulla 


£1 is minimization or basis pursuit (BP). The convex optimization searches for a minimum £1 norm 
solution. The BP [28] recovers the signal only if its measurement is free from noise. 
a. Algorithm for BP 


Input: A, Y where A-measurement matrix, Y-measurement vector 
Instruction: X=argmin||Z||, subject to AZ=Y 
Output: vector x’? 


b. Greedy pursuit (GP) 

Step by step method is implemented in greedy approach [28] and each iteration is selected by 
updated columns that are similar to measurements. 
c. Orthogonal matching pursuit (OMP) 

The algorithm is described as 


Input: A, Y where A-measurement matrix, Y-measurement vector 
Initialization: s°=6; x°=0 

stt=s u{jn +1} Jjnui=argmax {||A(Y — Ax)||} 

x™l=argmin{|lY — Az||} supp zcsmt 

Output :=x*t=x" 


d. Compressive sampling (CoSaMP) 

Parallel greedy algorithm not only selects by one atom but operates by selecting K or multiplies 
of K. CoSaMP selects 2K column of measurement matrix which will be added to previous k atoms and out of 
this 3K atoms the best K atoms are taken and updated. Subspace pursuit (SP) [29] selects only K atoms for 
each iteration which reduces the complexity. 

e. Threshold approach 

The solution set Si is updated using threshold operation. The iterative hard threshold (IHT) [30] uses 

a non-linear threshold operator nk keeping the largest k entries in S all others are set to zero. 


S = nk(s + AOT(Y — Os) (12) 


Where A-denotes step size, if the step size is fixed the algorithm will not recover while step size is adaptive 
[31] it becomes complicated. 
f. Combinal approach 

The algorithms make use of two methods count min and count median. In the count min method, it 
computes the minimum value from a measurement of the previous step. In the count median, the median is 
calculated instead of the minimum value. 
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g. Convex approach 

The £ p norm approach is replaced in the place of £1 norm where 0<p<1 and thus approach recovers 
the signal from the fewer components. A weaker version of RIP is enough to reconstruct the signal perfectly. 
h. Bayesian approach 

The Bayesian approach is suitable for signals of a probability distribution. The signals coefficients 
determining using maximun likelihood estimate or maximum posterior estimate. 

i. Block processing-based basis pursuit (BP-BP) 

The proposed basis pursuit along with block processing process the image using mean and standard 
deviation and based on the processed image, the measurement matrix and the DCT transform are performed. 
The processed image is then recovered using BP and the compression ratio is better when compared to other 
algorithms. 


Figure 3. Classification of recovery algorithms 


4. RESULT AND DISCUSSION 

The various recovery algorithms are analyzed by simulating the output for two different images, 
cameraman and Lena images. The peak signal to noise ratio (PSNR) and MSE of both the images for various 
algorithms are tabulated. The peak signal to noise ratio describes the quality metrics of the image. The PSNR 
is expressed as the ratio of the maximum value of the signal to the noise and it is expressed in the logarithmic 
decibel scale. PSNR is also defined in terms of MSE. MSE is defined as (13), (14), and (15). 


ee ie oe a 
MSE = meg 2 jz0 UG) B K(i, j)] (13) 
PSNR = 10 log 10 (2) o 
2 
PSNR = 20 log 10 (=) ai 
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Figure 4 shows the images of the cameraman, which was originally taken for compression, 
measurement matrix, the compressed image, and the recovered image with the calculated PSNR. Figure 5 gives the 
omparison of various recovery algorithm for the image’s cameraman and Lena at compression ratio 3:1. The 


PSNR and the MSE for the images are calculated and the tabulation of the images along with their recovery 
algorithms is tabulated in Table 1. 


Original Image 


Measurement Matrix 
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Figure 4. Images of cameraman compressed and recovered 
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Figure 5. Recovered images of cameraman and Lena with various recovery algorithms 
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Table 1. Comparison table of various recovery algorithms, PSNR, and MSE 


CS Algorithm Cameraman Lena 

MSE _PSNRindB _ MSE _ PSNR in dB 

BP 26.14 19.79 18.12 22.97 

CoSamp 40.09 16.07 26.50 19.67 

GP 29.64 18.69 20.66 21.83 

IHT 44.40 15.18 37.86 16.57 

IRLS 23.69 16.67 23.69 16.67 

OMP 32.08 18.01 20.03 22.10 

SP 34.66 17.34 22.30 21.16 

BP-BP 26.04 19.80 18.10 23.01 


Figures 6 and 7 provide the comparison chart of MSE and PSNR in dB for different images with 
different recovery algorithm. The results of various algorithms with two different images conclude that based 
on the sparsity of the images the recovery algorithms reconstruct the image with a compression ratio of 3:1 
which means 30% of the data are compressed and thus limits the storage and bandwidth of the system. 


Comparison graph for MSE of cameraman and Lena 
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Figure 7. Comparison chart for PSNR 


5. CONCLUSION AND FUTURE WORK 

The various compressive sensing recovery algorithms are compared and based on their analysis of 
comparison the recovery of the image depends on the measurement matrix used and the nature of the image. 
The proposed block processing along with Basis Pursuit is comparatively better in performance than the 
other algorithms and the compression ratio of the algorithms is found to be 3:1 which is a moderate 
compression ratio. Based on the present comparison the future work can be enhanced by compressing the 
image and transmitting the image through a wireless network thereby reducing the storage capacity and 
transmission rate. 
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